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LIST  OF  SYMBOLS 


X. 

1 

The  ith  element  of  the  sequence  of  the  time  intervals 
of  the  point  process. 

e. 

i 

The  ith  element  of  the  i.i.d.  exponential  sequence 
with  parameter  X  . 

EMAk 

Exponential  Moving  Average  of  order  k. 

3. 

1 

Probabilities,  0<$.<1,  i=l,2,3, . 

pj 

The  jth  order  serial  correlations. 

T 

r 

Sum  of  X.’s;  T  =X.+X  + . +X  . 

i  r  i  2  r 

<f>  (s) 
r 

— sT 

Laplace  transform  of  the  p.d.f.  of  T^ ;  (J)^(s)=E(e  r) 

p.d.f. 

Probability  density  function. 

Fr(t) 

Ntf) 

Distribution  function  of  T  . 

r 

The  number  of  events  occurring  in  the  time  interval 
<o'ti- 

(f)  t 

4>f  (z;  t) 

*Pf  (z;s) 

mf  (t) 

* 

mf  (s) 

The  generating  function  of  ;  E(z  ). 

Laplace  transform  of  l[j^( z;t). 

The  intensity  function  of  the  point  process. 

Laplace  transform  of  m(t). 

X 

Parameter  of  exponential  distributions. 

s 

Variable  of  Laplace  transform. 

£x.(s) 

1 

** 

£xi'Xi+llsl'S2) 

_sx 

Laplace  transform  of  the  p.d.f.  of  X^;  E  (e  i)  . 

Laplace  transform  of  the  joint  p.d.f.  of  X.  and 

xi+r 

A  /\ 

3,  3 

Estimators  of  3  • 
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<CL 


y 

Random  variable  Y  divided  by  its  mean  value,  i.e. 

Y 1 =Y/yy . 

A 

P  j 

Estimator  of  p.  . 

D 

iMs) 

Laplace  transform  of  the  p.d.f.  of  the  e. 
distribution . 

fBici'6iei+i 

Joint  p.d.f.  of  3,£.  and  B,£.  ,  • 

1  1  i  1  l+l 

x.(k) 

1 

X.  of  the  EMAk  process. 

l 

"  -n» 
CL 

The  jth  order  serial  correlation  of  the  EMAk  process 
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I .  INTRODUCTION 


Properties  of  the  stationary  sequence  of  positive  random  variables 
{x.}  which  are  formed  from  an  independent  and  identically  distributed 
exponential  sequence  {£_^ }  according  to  the  linear  model 

3£^  with  probability  3, 

(0-3-1; i=0 , ±1 , ±2 ,  . . .) 

3C.+S  , with  probability  1-3. 
i  i+1  J 


were  discussed  by  Lawrance  and  Lewis  [Ref.  1]  .  They  gave  a  fairly  com¬ 
plete  picture  of  this  model,  and  called  it  the  EMA1  (Exponential  Moving 
Average  of  order  1)  process.  It  is  clear  that  the  adjacent  elements  of 
this  sequence  are  correlated,  but  that  the  dependence  is  no  greater  than 

order  one,  i.e.  X.  is  independent  of  X.  X.  ...  and  so  forth  for 
l  1+2  i+3 

pairs  and  triples. 

In  this  paper,  methods  of  estimating  3  and  the  properties  of  the 
estimates  of  3  will  be  discussed,  and  then  the  properties  of  an 
analogous  second  order  process  are  investigated.  The  new  process,  called 
the  EMA2  model,  is  a  sequence  of  positive  random  variables  { X^ }  defined 
by 


X  .  = 

l 


w .  p .  3  ; 

2 


f  3 

2  1 

3  5. +3  £. 

2  1  1  1+1 

^3  £.+3  K  ^  +  £.,  w.p.  (1-3  )  (1-3  ). 
2  1  1  i+1  1+2  2  1 


w.p.  (1-3  ) p/0-3  r 3  -1; i=0 ,±1/ . . . ) ; 
2  *  2  1 


(l.D 


The  purpose  in  the  creation  of  this  model  is  to  provide  models  for 
data  with  longer  dependencies  than  that  obtained  with  the  first-order 
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model  and  to  examine  any  tendencies  of  the  upper  bound  on  the  serial 

correlations  to  increase.  For  the  EMA1  model  0<p  <1/4  and  p  =0  for 

k=2, 3,  ......  .  For  the  EMA2  model  it  is  shown  that  0<p^,  p^<l/4  and 

p,  =0  for  k=3,4,...  In  fact,  the  {x.}  form  a  sequence  of  exponential 
k  i 

random  variables,  and  it  will  be  seen  from  (1.1)  that  the  successive 

elements  X.,  X.  n ,  X.  0  will  be  correlated.  This  model  is  also  an 
l  l+l  i+2 

alternative  model  to  a  renewal  process. 

The  EMA2  model  is  shown  to  be  a  stationary  point  process.  Distri¬ 
bution  of  the  sums  of  X^  are  discussed,  and  the  joint  distributions 
of  two  adjacent  intervals  X_^  are  derived  and  appear  to  be  new  bivari¬ 
ate  exponential  distributions.  Extensions  of  the  model  and  estimation 
problems  are  briefly  'discussed. 

In  developing  the  properties  of  the  process,  the  similarities  to 
a  backward  second  order  moving  average  which  is  defined  as 


fB 

2  1 


X  .  = 
1 


5  .+8 
2  1 


5. 

1-1 


5.+B 

2  1 


w .  p .  B  ; 

2 

w. p. (1-S  ) B  (0-B 

2  1  2 

w.p.  ( 1- B  )  (1-B  )  • 

2  2  1 


B  -l;i=0 , ±1 

l 


(1.2) 


will  also  be  pointed  out.  Properties  of  the  processes  are  very  similar, 
but  those  of  the  forward  model  (1.1)  have  simpler  derivations. 
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II.  A  BRIEF  REVIEW  OF  THE  EMA1  PROCESS 


The  EMA1  model  is  a  stationary  point  process  with  exponential  mar¬ 
ginal  distribution  of  the  intervals  {x^}  .  Further  is  dependent 

on  X_^  and  X^+^  /  but  independent  of  all  others,  so  the  correla¬ 
tion  p  =  corr(X.,X  )  =  3(1-3)  ,  p  =0  for  k=2,3,.... 

1  1  i ■»  x  x 

The  Laplace  transform  of  the  p.d.f.  of  T  =X  +X2+...+X  is 


A  r  A  (A  +  23s)  1 r-1 

<p  (S)= - j - r-1  (2.1) 

A+s  l(A+3s)  [A+(l+3) s]j 


Let  be  the  number  of  events  occurring  in  the  interval  (0,t]  be- 

ginning  at  an  arbitrary  event?  and  let  F  (t)  denote  the  distribution 

of  T  ?  then 
r 

Prob{N^f )=r}=F  (t) -F  , (t) .  r^O 

t  r  r+l 

with  F^ ( t ) =1  for  t>0  .  The  p.d.f.  of  gives  the  generating 

function  as 

N^f)  CC  oc  r-l 

ECZ  ]=iK(z;t)=Z  zr[F  ( t )  -F  ,  (t)  ]=l+(z-l)  Z  z  F  (t).(2.2) 
f  r=0  r  r+l  r=l  r 


Inserting  (2.1)  in  the  Laplace  transform  of  (2.2)  gives 


*  3 (1+3) s2+[-3 (1-3) z+23+1] As+A2 

4>  (Z;s)= - - - -  (2.3) 

f  '  (s+A) [3(1+3)s2+(1+23-23z)As+(1-z)A2] 
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Differentiating  (2.3)  with  respect  to  z  ,  then  setting  z=l  ,  gives 


the  Laplace  transform  of  the  intensity  function 


mf  (t) 


as 


*  A  (A+Bs)  [A+(l+0)s] 

m  (z  ;  s )  - -  ,  (2.4) 

f  |3(l+8)s(X+s)  [s+X/(82+e)  ] 


and  inverting  (2.4)  gives 


mf  (t)  =  { 


X  { 1+ 


8 ( 1— B)  r  -Xt/(B2+8) 

67”B-rle 


-Xt 

-e 


]) 


X (l+83Xte  Xt) 


(B2+8*l) 

(82+8=l) 


The  joint  distribution  of  and  is  a  bivariate  exponen¬ 

tial.  Using  a  double  Laplace  transform  we  get 


** 


^Sl'S2^~^  ^sg)  1 (Bs^)  +  (1*“B)^  (s^+Bs2)]  [B+  (1“B) ^  (s^) ) 


X2 (X+8s1+8s2) 


(X+Bs^) (X+s2) (X+s^+8s2> ' 


(2.5) 


and  using  triple  Laplace  transform  gives 


Xi-l,Xi,Xi+l (S1,S2'S3) 


)  r6iMBs2)  +  (l-B)4>(s1+8s2))  [8*  (8s3)  +  (1-3)  ^  (s2+8s3>  ]  [8+  (1-3)  4>  (s3)  ] 

Differentiating  (2.5)  with  respect  to  s^  /  setting  s^-0^,  and 
inverting  with  respect  to  s^  and  then  dividing  by  the  marginal (exponen¬ 
tial)  density  of  X^_^  9  9^ves 


E«Xi]x:L_1=t)-X_lEeXt+  0.  ♦  ^  a-X<1-6)t/8]. 
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Similarly, 


,  -1  „  - (1-3) Xt/B, 

E(X.  X.,  =t)=X  [1+3-e  1 

i 1  i+l 


The  two  conditional  variances  are  given  by 


...  I..  ,.  ,-2  1-2B+2B3  282  (1+Xt)  ,-(l-B)Xt/B  B2  -2  (1-B) Xt/Sl 

v«(xi|x1.1-t)-x  I  "(i-s>2-  +  “iCi — e  •uteT2''8  J 


var(x.|x.+1.t).x-2  +  e'X  U-B)  t/B_e-2  (1-6)  Xt/B, . 


1-B  B 
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III.  ESTIMATING  g  IN  THE  EMAl  MODEL 


The  EMAl  model  is  not  time-reversible,  and  this  comes  out  clearly 
in  higher  order  joint  moments.  The  results  lead  to  a  method  for  esti¬ 
mating  3  in  the  EMAl  model. 

^  Cii2(k).E(X.  ^-ECXilEOt^), 

c2,i(kl'EOtiW-Etxi>E(xi+k)' 


which  when  k=l  gives 


C2,l <1)”E(XiXi+l,-E(Xi,E(Xi+l) ’ 


By  the  construction  of  EMAl,  we  have: 


?  P2e2 

x2  ={ 

B2G2+2Be.ei+1+e2+l 


w.p.  B' 


w 


.p.  (1-B)2. 


(0<B^1;  i=0,±l,±2,. ..) 


Hence,  using  straightforward  combination,  we  get  the  joint  expectation 


-  ^ 

of  X .  and  X .  n  as 
1  l+l 


E(XiXi+l)=E(  ^3ciCi+l)  S3+E  (  ^3eiGi+l+8?eiCi+2)f?2 

+E(eieiGi+i+262eiei+i+6ei+i)6(1"B)2 

+E(B3e2ei+1+2B2r-ic2+1+62e2ci+2+2Bciei+1ei+2+Be3+i+e2+i£:i+2)  (1-6) 3, 


Simplification  of  this  result  leads  to 

E  (X^X  .  )  =  -~t(2+43-232-233)  which  implies  that  C  _(1)=  — j3  (1-0)  (2+ -3)  # 

x  x+1  A  2 , 1  A 
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Similarly,  we  get 


E  (x  X2  )=  -tr(2+2S-233)  which  implies  that  c.  (1)  = 
i  i+1 


2^ 


(1-B)  (1+3) 


Therefore,  if  we  let 

=  (2+8)/ (1+3) , 


r= 


C2,l(1) 

Cl,2(1) 


(3.1) 


we  have  a  function  of  8  which  decreases  monotonically  from  2  when 
g->0  ,  to  3/2  when  g->l  .  Thus  there  is  a  unique  solution  for  g  for 
any  given  r  ;  note  that  when  g  is  0  or  1,  the  ratio  is  not  defined. 
Solving  (3.1)  we  get 


2- 


S,1(1) 

Cl,2(1> 


e=(2-r)/(r-l)' 


2C1,2(1)  C2,l(1) 


C2,ia>  ,  C2.1U)-Cl,2a) 


For  estimating  g  ,  define 


i=l 


Thus 


3= 


2h,2(1)-C2,l(1) 

S.l(1,-£1.2a) 


Now  we  check  all  the  estimators,  to  see  if  they  are  asymptotically 
unbiased  or  not. 

E[=l,2(1»-  ni;E«iXi+l>-E<+  . 

l=l  l=l  l=l 


l. 


14 


Examining  the  estimate  of  the  product  of  the  means  we  have 

l  Xt  •  j  xJ-(x1+x2+...+xn) 

-nxj+2(n-l) <xixi+1+xixi+1  )+(n-l) (n-2)x1Xi±2 


Thus 


E  ( 


1 


Yx.  Yx?  )=  — -n — -+r  [6n+2(n-l)  (4+66-2B2-4B3)+2n2-6n+4] 
L  x  L  X.  nz  A3 
i--1  i=i 

r=  -|rf^-(2+3B-32-2B3)  +  ~t  ' 

X^  n  n 


— 2  q 

and  when  n-*°°  ,  E  (XX  )->2/X. 


Thus,  since  the  estimators  of 
we  get  that  asymptotically, 


E(xixi+1> 

and 

of  E(X2X.+1) 

eiA2(i))- 

2 

“x3 

-  3(1-3) (1+3) ? 

E'E2,1(1)!“ 

2 

r  3(1-3) (2+3) . 

are  unbiased. 


1. e.  Both  of  these  are  unbiased  estimators  when  n  is  large. 

2.  We  now  look  at  the  ratio  estimator  of  3  t  namely  3  to  see  if  it 
is  asymxototically  unbiased.  Note  that  the  denominator  in  the  expression 

A 

for  3  is  identically  zero  if  3=0  or  3=1  ,  so  that  in  what  follows 
we  assume  that  0<3<1  .  Let 


2C1,2(1)_C2,1(1)=Y  and  let 


C2,l(1)~Clf2(1)r=Z'  Then 


E(Y)=2E[C  (1)]-E[C  (1)]=  -p-(2B2-2B3)=yy;  and 

E(Z)=  EfC  .(D1-EIC.  0(1)J=  -4r(23-232)=y  . 

2,1  1,2  .A  z 

.  V  y/y  V  Z_vz  _x 

Now  we  can  write  (Y/Z)=  — ^ - —  =  —  Y1  (1+  - ) 

y  z/y  y  y 

z  z  z  z 

Vv  7-Vz  Z-y7  2 

E  (Y/Z)  =  -*■  {E  (Y  ' )  -E  [Y  1  (- - ~)]+E[Yl  (-—)  ]- - }; 

^z  ^z 


where  Yl=Y/y^,  so  that 


(3.1.) 


we  assume  that  conditions  for  this  expansion  to  hold  as  n*00  are  met. 
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Since  u  /U  =B  and  E(Y*)=1  ,  if  B=Y/Z  is  to  be  unbiased,  we 
Y  z 

must  show  the  rest  of  the  terms  in  (3.1)  are  all  zeros, 
yhus  look  at 

E [ Y 1 (Z-yz)/yz]=E(YZ)/y  vz-l. 

we  have 


(YZ)  =  [2C1  2(1)”^2,1(1)]  [S,1(1)~C1,2(1)] 


n-1 


n-1 


n-1 


=  (n-ir2[2  2  X.X2+1-  Z  X2Xi  ]  [  Z  X2X  -  E  X.Xi+1] 
i=l  1  i=l  x  x  i=l  x^  1=1 

_0  n-1  2  n-1  , 

-  (x)  (x2)  (  Z  XX-  Z  X.X  )/(n-l) 
i=l  1  1+1  i=l  1 


,  n  n  2  2 

=[ (2U-W) (W-U) ]/(n-l) -[  Z  X.  Z  X. (W-U) ] / [nz (n-1) ] , 

i=l  1i=l 


where 


and 


n-1 

u=  z  x.x2 

i=l  1  1+1 
n-1 

W=  Z  X*X.  , 
i=l  1  1+1 


n-1 
I  U  .  , 
i=l  1 


n-1 

:  Z  W.  , 
i=l  1 


i.e.  U^X.Xt^,  , 
i  li+l 


i.e.  W  =X£X.+1. 


In  addition  (  2U-W)  (W-U)  =3UN-2UJ  -W2  . 


Further  we  get 


n-1  n-1  n-1  n-2 

UW=  Z  U.W.+  Z  U.W.  _+  Z  U.W.  +  Z  UjW.., 
i_l  i  i  i=3  i  1-2  i=2  l  i-l  i=1  1  i+l 

n'3  2 

+  Z_^UiWi+2+  (nz-7n+12)UiWi±3  , 


_  n-1  „  n-2  n-3 

U  =  Z  U  +2  Z  U.U.  ,+2  Z  U.U.  _+(n-3) (n-4)U-U- ,o 
i=l  1  i=l  1  1+1  i=l  1  1+2  1  X± 


2  nI1  2  n-2 


n-3 


W  =  Z  W.+2  Z  W.W- ,,+2  Z  W-W. . 0+  n-3) (n-4)W.W. 

.  ,1  .  ,  l  i+l  .  ,  l  1+2  i  i±3 

1=1  1=1  1=1 
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It  can  be  shown  that  all  these  joint  expectations  have  finite  expected 

value  so,  when  rr ,  those  terms  only  with  coefficients  n  will  go  to 

1  2 

zero  when  multiplying  by  (^y)  •  Thus  asymptotically. 


E[  ( 2U-W)  (W-U)/(n-l)  2]=E(3UW-2U2-W2)/(n-l)  2-- - 

3E(Ui)E(Wi+3)-2E(Ui)E(Ui+3)-E(Wi)E(Wi+3)  =  (46-462  +  46  3-861,  +  4B5)/A6, 


since 


and 


E(Ui)=E(XiX^+1)  =  (2+2B-2B3)/X3  , 
E(Wi) =E (X?Xi+1)= (2+4B-2B2-2B3 ) /X 3 , 


n  n 

Similarly,  e[  Z  X.  Z  XT (W-U) / (n  -n) ] - 

i=l  1i=l  1 

E(Xi)E(X^) [E(W±)-E(Ui) ]=(4B-4B2)/X6 , 

1  3  4  5 

Hence,  E(YZ)  =  —  (43  -83  +43  ),  when  n  is  large. 

x6 

Asymptotically, 

E  [ Y '  (Z-yz)/yz]  =  (4B3-8B,(+4B5)/(yyPzA6)-l=0 


In  (3.1) ,  the  rest  of  the  terms  in  the  braces  will  also  approach  zero 
when  n  is  large,  so  E(3)=3,  i.e.  3  is  an  unbiased  estimator. 

An  alternative  way  to  estimate  3  is  to  use 


B=  [ X  3C  ( 1 )]/ 2 p  - 1 


1  ,  2 


where  is 

an  estimator 

Of  | 

of  EMA1,  and 

P1=B (l-B)  . 

[Ref 

Define  a 

n-1 

P 

=A2 [  Z  X.X 
1  i=l  1 

i+l^ 

Then 

n-1 

,-v  2. 


A  n_J-  n  0 

E ( p  ) =X 2 {  Z  E(X.Xi  +  ])/(n-l)-E[ (  Z  X.)  ]/n2} 
i=l  1  i=l 
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Again  using  the  same  argument  as  above,  we  have 


E(xixi+i)=(1+B-62)/X2. 


Also 


so  that 


2  n  2  n-1 

"  " i +2  Z  X  .  X .  , +2  Z  Z  X  .  X  .  .  , 

i=l  1  i=l  1  1+1  i=l  j=2  1  1+3 


n  p  n  2  n~l  n-2  n-i 

(  Z  X . )  =  Z  X • +2  Z  X.X. , t+2  Z 
i=l  1 


E[(x)2]=n  2 [ 2n/X2+2 (n-1) (H-$-$2)/X2 


+  (n-1)  (n-2 ) /X  2 ] 


n-x* 


^1/X2  . 


Consequently  E(pp=X2{  (n~l)  ( 1+3-g  2  )  /  [  X  2  (n-l)]-E[  (x)2]  } - - 

Thus  is  an  unbiased  estimator  for  when  n  is  large* 

3  /v.  /\ 

Now  assume  n-*°°  and  let  Y=A  C  (1)  and  Z=2p  .  Thus 

1,2  1 

E (Y) =23 (1-3X1+$)  ,  and  E  (Z ) =2$ (l-$ ) , 


n-*-oc 


yy/yz=1+e/  lIyMz=4  (32— 33  —  34  +  3s)  , 


and  by  the  expansion  used  above 


PV  Z-yz  Z-yz  9 

E(Y/Z)=-x{E(y')-E[Y'  ( - )]+E[Y'  ( - )2]- _ }  (3.2) 


y. 


We  want  to  show  that  the  terms  in  (3.2)  beyond  the  first  are  zero,  so 
we  look  at 


E [ Y 1 (Z-yz)/yz]=E(YZ)/yyyz-l. 


We  have 

(YZ)=2X3PiC1/2 (1)=2X 


n-1  n  0 

[  E  xixi+i/(n-l)-(  Z  X./n)2] 
i=l  11  i=l  1 


n-1  2  n  n  2  o 

l  £  xixi+l/ (n-D-  Z  X.  z  X  /n2]. 
i-1  i=l  i=.l  1 


3 (1-3) 
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Therefore 


n-><* 


E  (YZ) - -*2  A  5  [E  (xiXi+1)E  (Xj-X?^)  -E  (X.Xi+1)E  (X±)E  (X?) 

-E(Xi)E(Xi)E(XiX?+1)+E(Xi)E(Xi)E(Xi)E(X?) ] 


=4 (32-e3-e4+e5) , 


so  that, 

E[V (z-yz)/Pz)=E<YZ)/pypz‘1=1'1=0' 

Similarly,  we  can  show  the  rest  of  the  terms  in  the  braces  of  (3.2)  all 
approach  zero  when  n  is  large.  Hence 

E(3)=E(Y/Z) -l=l+3-l=3, 

a 

i.e.  3  is  also  an  unbiased  estimator  of  3  when  n  is  large. 
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IV.  COMPARISON  OF  THE  ESTIMATORS 


S\  /\ 


It  has  been  shown  in  the  last  section  that  the  two  estimators  3,  3 
are  unbiased  asymptotically,  provided  that  3^0,  or  3^1,  but  when  the 
sample  size  n  is  not  large  enough,  the  bias  term  should  be  considered. 

For  simplification,  any  finite  term  divided  by  the  second  or  higher  power 
of  n  will  be  neglected. 

For  3  ,  let  Y=2C1  2^”C2  Z==C2  2^  m  A11  the  esti~ 

mators  here  are  defined  as  before.  Thus 


E (Y) =23 2  (1-3) /X  3 -4  (2+3  3-32-233)/nA3=vy* 
E(Z)=23(l-3)/A3=yz; 

E (Y/Z) =yu~1{l- [E (YZ) /u  u  -1) + - }  . 

y  z,  y  z 

Using  those  results  listed  in  APPENDIX  B  and  neglecting  the  higher  power 
terms,  we  have 

E (YZ ) =E (Y) E (Z)+ (-12-560 3+14723 2 -114 83 3 +53234 -11203 5 

+7403c+24837-16438)/(6n  . 

Hence  E(8)  =  [2yyyz-E(YZ)  ]/yz 

1  1 

=3+ - - - (12+528  3-14 883 2 +12123  3 -516 3 4 

462  (1-3)  2  n 

+108835-7403G-24837+1643e) .  (4.1) 

For  3  ,  let  Y=A  2(1);  2=2^  . 
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Again  all  the  estimators  here  are  defined  as  before.  Thus 
E (y) =  28 (1-3)  (l+6)-4  ( 2+33-B 2 -23 3 ) /n=yy ,  and 

E  (Z)  =2(3  (l-3)  +  (2+4  3-4  62  )/n=yz.  (4‘2) 

2 

In  (4.2) ,  the  maximum  value  of  (2+43-43  )  occurs  at  3=1/2  ,  and 
equals  to  3,  when  divided  by  n,  it  can  be  neglected,  so  1^=23 (1-3)  . 

Similarly  as  above  we  have 

E(YZ)=E(Y)E(Z)  +  (4-16  3  +  3  4g2  +  24S3-26B‘,  +  865-24£6  ) /n  , 
and  consequently 

E(f)=8+ - - -  — (-4+16B-22B2-326  3+14BI,+2466  )  .  (4.3) 

4  B  2  ( 3.  -  B )  2  n 

Now  compare  (4.1)  and  (4.3);  both  of  them  are  divided  by 
2  2 

4  3  (1-3)  .  When  3  approaches  0  or  1,  the  values  of  bias  term  will 
be  very  large,  though  both  of  the  sums  of  the  coefficients  of  the  3's 
in  the  parentheses  are  zero  when  3  approaches  0  or  1.  Figures  1  to  4 
give  the  shape  of  the  curves  of  f(3)  and  bias  for  different  values  of 

A 

.  /A 

3  .  From  the  figures  it  is  obvious  that  3  is  better  than  3  • 

The  variances  of  those  estimators  are  very  messy  for  hand  computa¬ 
tion,  and  have  not  been  worked  out  for  this  thesis. 
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22 


23 


<2L 

A 


2k 


<0. 
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V,  SOME  BASIC  ASPECTS  OF  THE  EMA2  MODEL 


The  simplest  aspect  of  the  EMA2  model  is  the  exponential  marginal 
distribution  of  the  intervals  {x^}  ;  in  point  process  terminology 
[Ref.  2]  this  is  the  synchronous  distribution  of  intervals  and  refers 
to  the  distribution  of  the  interval  from  an  arbitrarily  chosen  event  to 
the  next  two  events.  For  the  Laplace  transform  of  its  probability  den¬ 
sity  function  (p.d.f.)  f  (x)  ,  we  write 

x . 

1 

f*  w-.f.-*1! 

(5>1) 

using  (1.1).  Since  the  i.i.d.  random  variable  have  exponential 

distributions  with  parameters  X  ,  their  Laplace  transform  is  A/(A+s)  . 

Thus  (5.1)  becomes 


A+b,  *  $2*  fas  ^+^2  A+^o 

A 


Mb  * 


This  demonstrates  that  the  have  identical  exponential  distributions 
as  asserted.  The  parameter  X  is  the  number  of  events  per  unit  time 
or  the  rate  of  the  point  process. 

The  correlation  between  X.  and  X.  n  can  be  obtained  on  considering 

l  l+l 

the  product  of  X^  from  (1.1)  with 


i+i 


^i+l 

w.p 

^i+l+?l^i+2 

w.p 

w.p 
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Thus,  again  using  straightforward  conditioning  arguments, 


E(Xi  »X1+1  ^  ,B$2 Vi+1  ^2+E^2yi+l+^A^i+2^Wl  ^  1_,PP 

«^i+l+?2^1+l)P2?l  (1“%> 

+S(^2^i+1+^: 1^:  1+2*  ^  1^  1+3  ^2  ^  ^  ^ 

*E^2^1+1* ?2?A+ 1*  fe^i+l^'l+2'1  d“  ^  ) 

+S^2  V i+l‘i'?2^i^i+2T?2^ i+l'^A+l^i+a^ @1 

+B(?2^i^i+l+^?l^i'»2*!'fe^A+3+^l^i+l4^l^i+A‘»2 

+B(?2  V: 1+1*  ?2  Pl^i^i+2*  Pi  p2^i+l'!'Pl^l+i^i+2'!"P2^i+l^i+2 

+B(f2Vi+l+P2?iVi42+fe^A+3*r^2Pi^£+l+?l^i+l^i-*2 

+Pi^l+i^i+3‘4'?2^i+i^i+2‘iFPi^l+2'i^i+2^1+3^1”?2'>  * 


and  simplification  of  this  result  leads  to 

,) 


^«=ccrr(XifX 


1+1' 


cov(XifX1+1, 


(varXi«,varXi+i)‘- 


(5.^) 


Similarly  we  have 


P2«=corr  (X±  PXi+2)-^(  1-  (32)  (l-p1 ) 


(5.3) 
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By  the 

construction  of 

EMA2 , 

p_.=0  for 

j_>3  . 

The  result 

for 

P1  (5.2 

equals 

zero  when  B2=0 

and 

61=1  ,  or 

V1’ 

or  31=0  ; 

and 

will 

approach  its  maximum  value  at  3-^  (1~S2)  =l/2  .  This  occurs  when 
. B^=l/ [2 (1-B2) 1  •  The  result  for  (5.3)  equals  to  zero  when  32=0  , 

or  3^=1  ,  or  32=1  ;  and  will  approach  its  maximum  value  at  32=l/2 
and  B-^0  •  Therefore,  the  serial  correlations  of  EMA2  are  all  non¬ 
negative  and  bounded  above  by  1/4. 

Now  the  stationarity  of  the  EMA2  process  will  be  discussed. 

Define  E(X.)=m(i)  (5.4) 

E[Xi-m(i)j  [xi^k-m(  i+k)]  =Cov(Xi  ,Xi4_k)-(T(  i  ,  ifk)  .  (5.5) 

A  stochastic  process  with  a  discrete  time  parameter  is  said  to  be 

’’stationary1'  (or  stationary  in  the  strict  sense)  if  the  distribution  of 

X.  ,  X.  ,  . . .  X.  .  is  the  same  as  the  distribution  of  X.  ,  , 

l  l+l  1+3  l+k 

)<i+l+k  . . ,  '  for  every  finite  set  of  integers  {l,2 . j} 

and  for  every  integer  k  .  This  definition  is  equivalent  to  requiring 
that  the  probability  measure  for  the  sequence  {x^}  be  the  same  as  that 
of  {x^+^}  for  every  integer  k  .  If  the  first-order  moments  exist, 
stationarity  implies  that  E(X.)=E(X.  )  for  all  i,k=0,  +1,  +2,...  (5.6) 

1  1+K 

Since  (X. ,X.  ., )  has  the  same  distribution  as  (X.  _  ,X.  ,  .  )  ,  existence 

1  l+l  l+k  i+1+k 

of  the  second-order  moments  and  stationarity  imply 

a(i,i+j)=a(i+k,i+j+k)  .  (5.7) 

Setting  k=  -i-1  gives  a (i , i+ j ) =0 [i- (i+ j ) ] =a ( j )  .  (5.8) 

* 

In  the  normal  case  properties  (5.6)  and  (5.7)  determine  that  the 
stochastic  process  is  stationary. 
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A  stochastic  process  is  said  to  be  stationary  in  the  wide  sense  or 
weakly  stationary  or  stationary  of  second  order  if  the  mean  function 
and  the  covariance  function  defined  as  in  (5.4)  and  (5.5)  exist  and 
satisfy  the  relations  (5.6)  and  (5.7);  i.e.  the  mean  is  a  constant,  in¬ 
dependent  of  time,  and  the  covariance  of  any  two  variables  depends  only 
on  their  distance  apart  in  time.  Obviously,  any  process  which  is 
stationary  in  the  strict  sense  and  has  finite  variance  is  also  stationary 
in  the  wide  sense.  In  the  normal  case  discussed  above  stationary  in 
the  strict  sense  and  in  the  wide  sense  are  equivalent. 

We  have  proved  that  the  X^  have  identical  exponential  distributions, 
which  implies  that  E(X^)  exists  and  E (X^ ) =E (X^+^j  for  all  i , k=0,+l ,+2 , 
. . .  Also  we  have  cov^X^)^//? 

cev(Xl8Xi±i)- 

cov(XifXii2)=  •^[P2(1“P2)^1“?PJ* 

cov(Xi,Xi^)«  0.  for 

All  these  expectations  and  covariances  are  independent  of  time  i,  so  we 
conclude  that  the  EMA2  process  is  stationary  in  the  wide  sense. 

The  independent  exponential  sequences  and  EMA1  models  are  the  special 
cases  of  the  EMA2  model;  these  aspects  of  the  EMA2  model  are  described  in 
the  following  table: 
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Values  of  ($2 

in  EMA2  node! 

When  we  set 

sequence  reduces  to 

°’  ?i”?i 

51141  model 

& “fe*  h"1 

EMU  model 

Pi"  0 

Now  the  adjacent 
elements  are  indep. 
if  keep  no  change 

EMU  model 

X«g  K.P.  1 

Poisson  process  (l.i.d) 

°i 

V4+i  H,p*  1 

Poisson  process  (iei.d) 

0»^-  0 

X  K.P.  i 

Poisson  process  (i.i.d) 

This  gives  checks  on  most  of  the  results,  for  the  serial  correlations. 

In  the  3rd  case  and  X^+1  are  independent,  so  P1=0;  but  and 

X.  are  dependent,  so  p  =3  (l-$  )  ,  which  is  the  same  expression  of 

It 4  ^  £  £ 

p^  in  EMA1.  The  serial  correlations  in  the  last  three  cases  are  all 
zero,  since  all  of  them  have  i.i.d.  elements. 

Also,  even  the  backward  model  (1.2)  could  be  equally  treated  to 
produce  similar  but  different  results.  However,  there  is  no  time-reversi¬ 
bility  in  the  process,  in  the  sense  that  . X^}  does  not  have 

the  same  joint  probability  distribution  as  , X_^ / • • • *^_k^  ^or 

finite  k,  where  k>2  . 
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VI .  DISTRIBUTION  OF  SUMS  IN  (xj  SEQUENCE  OF  THE  EMA2  MODEL 


In  the  point  process  theory  of  the  model,  the  distribution  of  the 

sums  T  =Xn+X^+*..+X  are  very  useful;  if  these  can  be  obtained  then 
r  1  2  r 

the  distribution  of  counts,  both  in  the  synchronous  and  asynchronous 

mode,  can  then  be  derived*  It  would,  therefore,  be  a  particularly 

attractive  feature  of  the  EMA2  model  if  the  distribution  of  the  T  could 

r 

be  obtained*  Unfortunately,  it  is  not  possible  to  get  a  simple  expres¬ 
sion  of  the  Laplace  transform  of  the  p.d.f.  of  T  as  in  EMA1 . 


r 


However,  a  general  derivation  will  now  be  given.  Define  i|j(s)  as 
the  Laplace  transform  of  the  p.d.f.  of  the  e ^  distribution;  except 
where  otherwise  remarked  this  distribution  is  exponential  of  parameter 
X  and  so  (s)  =A/ (A+s)  .  Define  the  triple  Laplace  transform  of  the 


p.d.f.  of  T  ,  e  .  and  e  ^  as 
r  r+1  r+2 


$  •  «  o  o  ♦  e 


(6,1) 


For  r=l  ,  we  have 
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Now  we  relate  ^Si/S2  '  S3^  anc^  ^r-1  ^Sl' S2 f  S3^  usiR9  the  expression 

'Tr-1 t:*P*  P2 

Tr^M+Xr|Tr-l+^r+Pl4+l  W»P« 

'  w*p* 

Then  we  have 

4)r(=t  .S2.S3)-=s{e“Sl  <T^-i+^^)'e2£^1_S3^J^ 

+E^l(Tr*1+^Sr+^£r+‘+^2)"S2£r+l's3£r+2j(1_p2)(1_p) 


"  tpx-1  ^51  *  fesl  *s2^ 

Continuing,  we  can  write 

$r-i  ^nl '  ^*1  ,SZ^‘,<Pr-Z^l'^Zsl  ’  ?2S1 )  1//(sg)?2 

+^r-2(°i'(32si*?iei+|si)[(51(,-(|)!Ks2)-Ki-^)(i-p1)^3l-ta2)]. 

4,r-l^sl*feEl'6sl'ta2^“4r-2^sl,4sl’fesl^,//^?l6l'te2^2 

+^r-2(sl»p2!5l»Plal+(32sl)  • 

f?l  (i-^)^(  ?1S1^2)+(l-f1 )  (1-|)  ^(Sj+PjGj-hljj) J . 


and  solve  it  recursively;  the  procedure  is  difficult  by  hand  but  could 
possibly  be  manipulated  on  a  computer.  Setting  s^O  and  s^=0  '  we 
have  the  Laplace  transform  of  the  p.d.f.  of  . 
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The  first  few  sums  have  transforms  as  follows: 


<J)  (s,0,0)=  ^7  which  implies  that  T1=x1^  exponential  (X)  as  is 


expected.  For  we  have: 


.  a  A  [Cvtfo5 )  p2)j 

(p2'GpGt°'  (A+  p2s )  (A-te+fys ) (A* (^s+^s)  (6.2) 


If  we  let  3-^=1  /  (6.2)  reduces  to 


A  ACVf2@,s) 

X*  which  is 


the  Laplace  transform  of  the  p.d.f.  of  T2  in  EtlAl .  [Ref.  1,  p.8] 

X  2 

If  we  let  3  =0  ,  (6.2)  reduces  to  (r— )  which  implies  that  T 

1  A+s  2 

is  the  sum  of  two  independent  exponential  random  variables. 


For  we  have 


A 


A2((a)(b)+(o)(d)J 


<fe^’°’0)"  A+3  tA+S'tfyE+^s)  (\+3*p2a)  (A-ts+Pj. )  (A+fi,e J*“ ’ 

where  A-[32(24+3?1§2+(^?2)+A=(3?2+2P1)+A2J(l-p2)  (6.3) 

B^3^lp2+ft^+^2+Pl?2>'i'As2(p2+p§+3p1f2+pf^«(31)+A2s(l«f1+2?2)+A3 

D^3(2j3|^Pp|«flp2)^s2(J(3|^(31p2+^)+S2A('*P2-f2pi)+>3. 


If  we  let  e<5ua^-  to  zero  or  one,  we  have  some  interesting  results. 

When  B2=0  ,  (A)  (B)  =X2  (X+s)  (X+ 23-^s)  2  and  (C)(D)=0  ,  so  that  (6.3) 


reduces  to 


A  r  A(A+2(3ts) 


_ [  _ r 

A^  1  '(A+^s^s) (a+(^g) 

which  is  the  Laplace  transform  of  the  p.d.f.  of  in  EMAl  for  3=3-^  • 
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When 


fy-l ,  A«(  1-  (|)  (A+  (32s+2s  )  (A+2  (3£s ) ,  B~(A+  P2s )  (A+2s  )  (X+3+  P2s ) , 
C=(^(A+2s)(A+2s+P2s)  and  D^(A+2P2s)  (A+s+^a)2, 

and  this  will  give  the  same  result  as  above  for  3=B2  • 

When 

(|-lf  (A)(B)«  0,  (C)(D)-(A+2c+P1s)(A-{s+P1s)3C\+2s), 

3  3 

(6.3)  reduces  to  A  /(A+s)  ,  indicating  that  the  {x^}  sequence  are 

i . i . d .  exponentials . 

When 


P  «  0,  A=(i-P2)(A+p2s)C\+2p2s),  B«A(A+p2s)(A-i^(32s), 
(>P2(A+3)(A+s+P2g)  and  lHA+P2s)2(A+2p2s) 


so  that  (6.3)  reduces  to  ,  .  \ 

.  ,  A(A+2fes) 


which  means  and  X^  form  an  EMA1  model,  X^  is  exponential  (A) 

and  independent  of  X^  and  X^  . 
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IN  EMA2 


VII.  THE  JOINT  DISTRIBUTION  OF  X.  AND  X.  n 

- -L  -  i+l- 

We  now  discuss  the  joint  distribution  of  X.  and  X.  which  will 

1  i+l 

be  a  bivariate  exponential  distribution.  Several  authors  have  discussed 
bivariate  exponential  distributions,  including  Downton  (1970)  ,  who  makes 
some  comparisons  with  those  of  Gumbel,  Moran  and  Marshall-Olkin .  The 
distribution  to  be  discussed  here  does  not  appear  to  be  one  of  the 
earlier  ones,  although  it  is  fair  to  say  that  in  common  with  earlier  ones, 
it  is  not  the  ‘perfect*  bivariate  exponential. 

The  double  Laplace  transform  of  the  joint  p.d.f.  of  X^  and  X_^+^ 
easily  calculated  using  (1.1);  the  required  expectation  is 


-s«X, 


E 


,  (s„bJ 

;  Wi  & 


{*  1 

Ej;-fesl£l-s2(p2£i+1+^£i+2+4+3^2(1.^)(1.pi) 

^  ^1+1 ) “n2 (  l*2+£|L+3 ( 1  -f  2)2(  ) 

{o'®1  (  ) 

1  (  Mi+  Pl^i+l+4+2 ^2^ 2^1+1+ ft£i+2^  ^(l-^)2^-^) 

1  ^2S1+  ”®2^  ?2^1+1+  ?igi+2+£i+3^J  ( l-(32)2(l-p1 ; 


+E|e 


+E 


+E 

+E 

+E 

+E 
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which  can  be  written 


fXA  ,Xi+1  (Sl"°2'l“,i/^,?2S1  ^  @2  ’K  p2E2^ 

^2(i-P1)(i-P2#(^2)^(?1=2)V/(s2)+'/'(?i=1^232)V/(sPJ 

+^(1"P2)2[-^((313!+(J2o2)i//(?iS2)J 


+Pl(1"P2^2^1'?l^V/^l3l'f',2s2^V/^lc2^V/(s2^+,//^lsl+f2!!2^^‘ii+PlG2^J 

+(l-?1)2(l-|)2fl//(P2sl^(?lsl+?2s2)^sl+Pls2>1i/(s2)jj 


A2[(A+p. 


Cx+^b"  )  (\+s'i )  (\^2Mf31+ ^spxv^j+^sp 

(7.1) 


We  note  that  (7.1)  is  not  symmetrical  in  s^  and  s^  /  and  this  is  to 
be  expected  since  the  process  is  not  time  reversible;  this  is  one 
feature  which  distinguishes  it  from  earlier  bivariate  exponentials.  The 
backward  moving  average  model  (1.2)  corresponding  to  (1.1)  has  the  joint 
interval  distribution  which  is  specified  by  (7.1)  with  s^  and  s^  in¬ 
terchanged  . 

An  explicit  form  of  the  joint  distribution  (7.1)  can  be  obtained 
directly,  rather  than  by  inversion  of  the  transform  which  is  less  infor¬ 
mative.  By  the  structure  of  the  model  the  joint  distribution  of 
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(X  ,X  )  is  a  mixture  of  the  joint  distributions  of 

^4'44+P*  44+i+^l4+2^  *  ( 44  * 44+1*44+2*4+3^ * 

(  44*  Plf i+1  •  4^  1+1  ^  ^  44*  44+1  *  44+1*  44+2*4+3^  * 

(  44*  44+1 » 44+1*  44+2^  5  (  44*  44+1*4+2  ’  44+1* 44+2  ^  * 

( 44*44+1*4+2 '  44+i ^ ^  44*44+1*4+2  *  44+i* 44+2*4+3^  • 

with  corresponding  probabilities 

Pi-  P&d-fe).  ?2(‘-P2H1-Pi).  WH>* 

^d-p2)2.  ^d-p/d-pp.  p2d-p2)d-p1).  d-p2)zd-p[)2. 

These  joint  p.d.f.'s  can  be  listed  in  an  obvious  notation  as  follows: 

A 

*44*44 4(X,y^“(A/W  e^PC-A y/^2)  (x,y>0) 


f%£1.f2£,+1+?1£i+2(!:’3r)°A2/,[P2^r?2)J 

•  oxpC-Ax/^^expC-Ay/^p-expC^y/pp]  (x,y>0) 

V+ Vlw . tx~ exp('A7/?2^  (?z*>?iy>0) 


f  Vi  •  ?2£i+i+Pi£i+2^i  f3(x'y)“  [(1‘  &><  (H>>J _1 

.  oxp(-Ax/ p2)|oxp(-Ay/ ^2)-€xp(-Ay/^1)~exp(“Ay)+0xp[-Ay(l+  |r  -’^)j]  (x,y  >  0) 
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The  other  terms  are  more  difficult.  For  example,  take 


’  44+l+?l4+2^ 

lot  yfe+l+Plfi+2’  a"?l4+2'  thTO 

ti+z"  z^v  k ♦r(y-!S)/fe»  Ei’b-t-hf-tyWzVh’ 

and  the  Jacobian  equals  to 

and  “hich  ^plics  that 

&y-Piz  Piz  >  =^s  >?-&/&• 


Thus  when  '  We  inte9rate  with  respect  to  z  from  zero  to  y  , 
but  when  ^2X<^1^  /  we  integrate  with  respect  to  z  from  to 
y  .  Hence  we  have: 


when 


?2X>^Ly  >0 

{exp  [^y  ( p2“P: \  )faZ}oxi>(-Ay/p1, )] 


when 


f  <&♦{&«  ■  P^+l+¥i+2(3"y)“A2(^PlP2^r1'  “:P(‘Ay/(3l)' 

[exp  )/?i}^P(tW(yJ 


For  $A*hh*v  hk+i*^k+z*h+3> 

lot  X=|£i+^i+1,  r-|£1+1*?1£1«+4t3>  a-Pi<W  "*4+3'  **■“ 

4+3^- 4+2“z/?i-  £i«’<y-a-H)/fe- 

and  Jacobian  :p*  a*50  (5llVi+lc^2^i+  ft7~ &2~  &W  *  V?hiCh 
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implies  that  >@1?-? iz"^iw  >^y‘*^1z“^ix^w>y-s-P2x/(31j  for 

y<z+(^x/^,  Integrate  w  from  zero  to  y,  for  y  >  s+  (^x/ (3^ »  integrate  w 
from  y-z-(^x/^  to  yj  and  in  tho  2nd  stepj  since  y  <  s+(^x/p^  implies 
that  z>y“^>:/^ »  if  (^y  <  *  integrate  a  from  zero  to  y ,  if  (^y>  (B^x, 

integrate  s  from  y-^x/p^  to  y;  also  y>a+(^/p^r^3  <y~^x/^,  thus  if 
^x<^yv  integrate  s  from  zero  to  y-p^x/p^,  if  ^y<^,xt  f(z)*Oj  hence 


for  the  expression  of  jf 


when 


P2^i+  ^  i+i  *  fe£l+l+  &£i+2+^+3 
z  >y-p2x/p1;  ^x>^y>0. 


(x,y), 


f  (x.yM^2  f-pifeH^+Pi-ftsJj'1'  «p("-«/|32)  • 

(e^["Ay(i/^2-?y(5^-«^(-Ay)-«xi'(-Ay/^1)',oxi'(-AT(1+1/ij1+?1/p2-i42)]j 

when  z  y- (32x/pi ;  j^y  >ffc  >  0 

f(Xly)K02X)2^|^^2)(f^frf2)J-1[exp(^^2)^p(-Ayli-f2/fp/^j]- 
{expfoy(l+l/p  1+P1/p2“1/p2)J  “exP(r\y/^1)J 

when  2<y^/p1f  fty<  ^ 

f(x,y)“  0 

when  z<y~Pf:/fi?  Piy>P2*>0 

{oxp[-Ax(i-P2)/f1J^p(“Ay)-«p((-ypi)(x^-x(52/(!i)il 

-C\p2)2((^^rf1p2H^(Jrfe)J"1{exp[-''(x/fe-,7)i 

-exp  [-AxCl-^/jJjypJexp^Ayd+l/^+fi/fl-l/fe)]  } 
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The  rest  can  be  derived  in  a  similar  way.  We  thus  see  that  the  joint 

p.d.f .  of  X .  ,  X .  „  will  be  continuous  in  both  variables  but  will  have 
1  l+l 

different  analytical  expressions  over  the  regions  32x>B-^y  and 
^2X<^1Y  '  t^lere  aPPears  to  ke  no  compact  analytical  form  for 
f  (x,y)  .  This  is  unfortunate  because  it  makes  it  difficult  to 

X  _  ,  A.  .  _ 

1  1+1 

derive  maximum  likelihood  estimates  of  the  parameters  X  and  3  in 
the  model. 

Different  bivariate  exponentials  also  can  be  compared  through  their 
conditional  properties  and  so  we  will  derive  these  for  the  present  con¬ 
tribution.  Conditional  p.d.f.'s  are  not  succinct  enough,  and  so  we 
concentrate  on  conditional  moments.  These  nay  be  obtained  from  (7.1). 
For  instance,  to  obtain  E (X^ | X^+^=t)  '  differentiate  with  respect  to 
s  ,  set  s  =0+  ,  multiply  by  -1,  invert  with  respect  to  s  and  then 

XX  ^ 

divide  by  the  marginal  (exponential)  density  of  X^+^  *  Thus 

+(^1-2P2+P1fz)H:p[-At(l-p2)/(32]/(Pi-p2)] 

Examining  this  regression  function  more  closely  we  see  that  E(X^|x^+^=t) 
is  equal  to  X  ^  for  32=0  anc*  B^  equals  either  0  or  1;  otherwise  it 
increases  exponentially  from  ^  to  constant  value 

(l+6^32+B^)X  1  as  t  increases.  But  when  B2=l  and  B1=0  / 

B (X  | xi+1=t) =3/X  which  is  the  maximum  value  for  large  t. 

The  conditional  moment  ^=t)  can  be  obtained  similarly  by 

interchanging  s^  and  s 2  . 
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VIII.  SOME  BASIC  ASPECTS  OF  THE  EMAk  MODEL 


By  the  constructions  of  EMA1  and  EMA2  model,  we  can  write  the 
general  form  of  EMAk  as: 


K.p. 


"Pk£i+§c-i^i*H+^-2£i+2  ’ 

i+l+*  •  *  + 


«.P. 

w.P. 


(8.1) 


w.p.  (l-?k)(l“Pk-1)...(l“?1) 


Methods  of  mathematical  induction  will  be  used  to  prove  some  basic 
properties  of  the  EMAk  model. 

1.  The  general  closed  form  of  EMAk  (k~l , 2 , 3 , . . * )  is 


k 


■+j 


5 


If 


T(k+l-n) 

Ai  v 


t 


(0.2) 


where  3q  and  I^+1^  are  defined  to  be  identically  1  for  all  i; 

(m ) 

1^  is  an  i.i.d.  sequence  of  Bernoulli  random  variables 

(m ) 

with  I.  =1  w.p.  (1-3  ),  0  otherwise  for  all  m; 
l  m 

i  is  the  serial  number  of  the  ith  element  of  the  series; 
k  is  the  order  of  the  process;  j  and  n  are  indices. 
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Proof : 


When  k=l 

w.p.  Pj 

w,p*  ^1 


When  k=2 


X  .A  9  t(3)+Ap  t(3)t(2)+ A  P  i(3)i(2)i(1) 

Xi  ^iXi  '1  l+l  i  Xi  +r0Ci+2Ii  h  I1  » 


W.P.  p2 


■^i+?A+l*  H*P*  ^“^Pl 

W,P* 


Assume  the  result  is  also  true  when  k=m  then,  when  k=m+l 

m 

^h-rw  ■  ‘'B+i-ri+j  nn0 

n+l  3 


V  ZW*i  Wm 


£fU,£~  111 


(m+l+l-n) 


j«0 


J  i+<5  ii*1 


This  completes  the  proof. 
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2.  The  distribution  of  the  intervals  {x^}  are  also  exponential. 

-sX. 


Pi'ooft  fY  (s)“E(©  1)f  1,©, 


fY  (g)«=E(o 


W3&t  £.  £,,  — s(3_ 

ki)Pk+B(e  'k  1  k_1  il)(5k.i(l~Pk)+..»« 


Aft<  xk+1(i-p1)...a-(y  ,  , 

+  *  W*Wfa)„\(wks)  (8'3> 


When  Ir”lp 


•s- 


APi  .  A*d-ft>  A 


\+^s  4  Ix-^s)  (x+p^)  " 


When  k=2 


«n  _A_Jfl  A(l-02)d+fts)i  A  r„  Ad-|32)  | 
^^"A+^slfe “(A+DtA+f^sJ  J  'x+fcfilPz  A+s  J=A-is' 


When  k=m-l,  the  last  term  of  (8.3)  is 


TCviSTi; X+f^s)  (x+pm.p; . . .  ix+fes j  • 


Assume  the  result  is  also  true  when  k=m-l,  then,  when  k=m  the  last  two 
terms  become 


xV-&(HU)...(i-fe)pt  x^a-fiX'-iW  ...  ('-ft)  . . 

0v+(3ffis)(x+pn_1s;..e  '(X+fa s)  k+s)  U+&0 U+fta-is7 •  ♦ . (X+fts)  ^  ' 
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but  all  the  terms  before  these  two  are  still  the  same  as  k=m-l,  thus 


simplifying  (8,4)  gives 


(X*s)  (X+pi  )  (V^s) 

(X4s)(X!^iaskX+^E1-isk  •  •  * 


★ 

which  is  exactly  the  last  term  of  f  (s)  when  k=m-l.  Hence 

x . 

i 

proved  that  if  the  result  is  true  when  k=m-l,  then  the  result 
true  when  k=m.  This  completes  the  proof. 

3.  The  jth  order  serial  correlation  of  EMAk  is 


$>■ 


k— j’tl  i-1 

w  ^k+1-1  2oCl“^- 


i+j-1 


«  0 


where  ^®l»and  ^+j“  0* 


Proof:  By  definition 


we 

is  also 

for 

for  I;  <Cj 
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s  are  intervals  of  EMAk  process,  and  have  been  proved  to  be 


where  X 


(k), 


marginally  exponentially  distributed  with  parameter  A  .  Thus 

|val[x^)var(x^)|2=l/A2.  and 

fW.  X2{E[xWx«)-E[x(k)]E[x^]]  . 


(k)  (k) 

Since  and  are  probabilistic  linear  combinations  of  i.i.d. 

exponential  (A)  random  variables  and  j  '  and 

(h) 

the  only  non-zero  term  of  will  be  the  sum  of 

Ex2[E(fi-i-j£i+j)*E^i+j)s^i+j^]“BA2(2-iA'2"E- 

where  B  is  a  combination  of  3^  and  (1-3^)  ,  for  i=l,2,3,... 

Hence  when  k=l,  j=l, 


/  N  1  1-1  i+1-1  r> 


i-1  i+1-1 

..*.*-*  ^“^1+1 -21^1+1-4-1  A 

1*4  ra^O  n  i 


When  k=2,  j=l. 


i-1 


"|(1-?3)P1(1-P2)+P1(1-P3)(1-P2)(30(1-^)(1-^) 
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When  k=2,  j  =  2. 


& -  iP-i 

-p2(i-e3)i?0(i-p2)(i-?1)^(i-p2)(1-?1). 


When  k=h,  assume  the  result  is  also  true,  then,  when  k=h+l,  j-h+1, 


h-i+l 
pW-  >'  [ 
'  0 


^  ?h+l-i  ir(l“?h+l-m^h+l-a-i 

i~i  i+j-1 

+^h+l+l-(h+l-j+l)  J^^+l+l-m^h+i+l-j-l  ^  1 

fc+1-3  i-1  i+«H 


^L+l+l-n^ 


This  completes  the  proof. 

4.  All  the  correlations  are  non-negative  and  bounded  above  by  1/4. 
Proof :  From  above 


k-j+l 


<Wi  ]T  U4+l-m4+l-j-l  E  (14+l-n> 


l+j-i 

E 


“^k-j  ”^icM -j  ^ 


+?.(i-4)(i-^.1)...(i-?3+1)(i-pk)(i-6!.1)...d-?1). 
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When  k=l,  j=l. 


p^1)=B1(i-B1)  , 


When  k=2,  j=l, 


When  k=2,  j  =  2, 


min.  value=0  at  3^=0  or  1, 
max.  value=l/4  at  3^1/2. 

Pl2)=3l(1_32)-[3l(1'B2)l2' 
min.  value=0  at  (3^=0  or  32=1, 

max.  value=l/4  at  B  (1-g  )=l/2. 
P22,-B2(1-ei,(1-|32)' 

min.  value=0  at  3^=0  or  3^=1  or  32“1/ 

max.  value=l/4  at  ^>^=1/2  and  3^=0. 

min.  value=0  at  3m=0,  m=j , j  +  1, . . . , k 

or  3  =1/  m=k,or  k-l,...or  k-i+1, 
m  J 

max.  value=l/4  at  3  =1/2  and  3  =0  for  m/n, 

m  n 

where  m=k,k-l,k-2, . . . , j . 

5.  Define  the  i+lst  element  of  EMAk  to  be 


When  l<j<k, 


rp> 


A+i# 


?A+l+4-A+2* 

1+1  ^  ?A+i+ ^k-1^  i+2*'  &-A+3 1 


X&M 


”tP. 

w.p.  (i-4)Pk-i 


A£i+l+(k-l W-  •  Wl+?1  ( } 


and  define  the  ith  tlement  of  the  k+lst  order  process  to  be  x|k+l)  , 
then  we  can  write 


w.p.  Ptn 

(0^+jl*1*  (8*5) 

*.p.  i-PfcH 


Proof : 


When  k«l» 

y(0b  0  £ 

Xi+1  '1  i+1  * 

w.p. 

fi 

”^i+l+^i+2  * 

w.p. 

H 

Then 

w.p. 

f>2 

"%k+QA+i  • 

w.p. 

(I-?,)?! 

w.p. 

d-Ppd-ft) 

When  k*=2, 

w.p. 

1 

w.p. 

d-P2)?i 

V3^5M+  ^i-J-2+^i+3  * 

w.p. 

Then 


“(*A+4£J.-u  ’  ''•p’  (1"?3^2 

-%ei+^l+l+&£i«'  M-p‘  (1^3)(1'&)ft 

” ^l+2+?l+3'K,P’  (1“^3) 


When  k=m-l,  assume  it  is  also  true,  then  when  k=m,  do  the  same  job, 

will  get  exact  the  correct  result,  this  completes  the  proof. 

Note  that  this  expression  is  not  convenient  for  the  purpose  of 

(k) 

examining  the  properties  of  the  EMAk  process,  since  and  are 

dependent;  however,  it  may  be  used  to  generate  the  {x^}  sequences. 
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IX.  CONCLUSIONS 


1.  Both  estimators  of  3  are  not  very  good,  since  the  bias  terms  are 

A 

/N 

very  large  when  3  approaches  to  zero  or  one.  But  3  looks  pretty 
nice  when  3  is  in  the  interval  (0.1,  0.8). 

2.  Estimation  of  3  in  the  EMA2  process  is  rather  difficult,  because 
it  is  impossible  to  get  the  unique  value  of  the  estimators. 

3.  In  successive  stages  of  queueing  lines,  all  the  waiting  time  ‘(waiting 
time  in  the  queue  plus  the  service  time)  in  each  stage  will  not  be 
independent;  this  is  the  basic  purpose  of  constructing  this  model, 
the  size  of  the  order  k  depends  on  the  number  of  stages. 

4.  The  general  expression  of  the  EMAk  model  is  not  convenient  for  the 

purpose  of  examining  the  properties  of  the  EMAk  process,  since 

(k) 

and  are  dependent;  however,  it  may  be  used  to  generate 

the  {x^}  sequences. 
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APPENDIX  A 


METHODS  OF  GETTING  JOINT  EXPECTATIONS 


1.  The  standard  way  to  calculate  the  expectation  of  two  or  more  jointly 
distributed  random  variables  is  to  integrate  the  function  with  res¬ 
pect  to  the  joint  p.d.f.  of  the  random  variables;  e.g. 

E(XY)=  Jx  jy  xy  fX|Y(x»y)  tady* 


This  is  not  convenient  for  the  expectations  we  require. 

2.  In  the  EMAl  model,  a  better  method  of  getting  joint  expectations  is 


to  write  out  the  expressions  from  the  basic  construction  and  compute 
them  directly.  For  example:  '‘•p-  P’ 


*^1^1+1  w.Pt 

xi+r$  ^1+1  w*p» 


thus 


.2 

w.p,  » 


..3c  ^2  ^3 


“j5’,£1£f+l+2f''^i£l+l^l+2+f,2£i+l+2?£l+l£i+2',lJ£iC'i+2''fl+i£i'i2’ 


W.p.  (1-^) 


By  direct  computation,  vre  havet 


E(XiXi+lXit2)E4^5  W*P* 

«(l?.p5t28p4+28(33)/x5  w.p.  £?'(l~(3), 

=(  12(^+56p4-J76p3+52/^)/A5  w.p.  (3(l-(3 )2» 

»(4(i5+28p.4448(2,3+52(2)2+l6(i?'f4)//^  w.p,  (l~p)3. 
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Combine  the  above  gives 


E(Xix^1X^2)-(^^2°^2~2°p,3+S(i5-12(’6)/A5t 

All  the  expressions  listed  in  APPENDIX  B  were  computed  in  this  way. 

3.  Take  the  derivative  of  the  Laplace  transform  of  the  joint  p.d.f.  with 
respect  to  s_^,  and  then  setting  s_^  equal  to  zero  will  also  give 
the  joint  expectations,  e.g.  Lawrance  and  Lewis  gave  the  general  ex¬ 
pression  of  Laplace  transform  of  the  joint  p.d.f.  of  r  adjacent 
intervals.  [Ref.  1,  p.17] 

Converting  it  gives: 

^y  y  y  y  »sp>so»‘\/ 


AV 

fSi^s2)  (X-K3 

s?+ps3)  (A-i-Qs^s,,) 

(X^p3^)  Sg)  Xv*  '  §32 

)  (x<iV 

Take  the  derivative  of  this  with  respect  to  s^  twice,  s^  once, 

s^  twice,  and  s^  once.  Then  set  s_^=0  (i=l,  2,3,4)  to  get 
2  2 

E (X . X .  nX.  _ X .  .)  .  Note  that  when  the  order  of  the  derivative  is 
l  l+l  i+2  i+3 

odd,  one  should  change  the  sign  of  the  expression.  This  is  a  messy 

job  by  hand  but  one  done  easily  by  computer. 

4.  An  alternative  way  is  to  use  "cumulants"  or  "semi-invariants" 

[Refs.  8,  p.253  and  11,  p.55-93] .  Let  L  be  the  Laplace  transform 

of  the  joint  p.d.f.  and  L*=log  L.  Let  L*2112  denote  th e  derivative 

of  L*  with  respect  to  s^  twice,  s^  once,  s^  once,  and  s^  twice. 

2  2 

Since  L*^=L^/L  and  L*^=  [L2*  L^L^)  ^  /L  and  L(0)=l  ,  these  imply  that 
L*1  (0=^(0)=  -E  (X)  and  L*2  (0)  =L2  (0)  -  [L  (0)  ]  2=  var(X). 


51 


If  we  denote  L*jm(0)=  K.^  and  E(xj  X^)-  Ejn  we  get  from  this 


relationship  the  following 

,2 


Eir  K11+  Kr » 

E2i“  -*2i-«i<san'«2o)-Ki' 

E12'  -K12-^l  «2K11-HC02>-K1 1 

B22“K22^1(K12*2l)+2Kll'*20K02+?Jtl(;S:il+K20)*li 

Ei3=k13«1(k03+3Ki2)+3k1sKo2+2^(k1i«02)^) 

^-K3l«1(K30H^)49K11K20+3lcf(K11-«2o)-Hi5', 


where 


Kr  xio"  Kor  -*A  ■  -s0r  -Eio. 


Also  Kn"(?-f>2)A2. 

K20“  K02”l/>'2' 

E12-(2p3.2p)/A3, 

K21-(2(!?-2^)/,\3, 


APPENDIX  B 


LIST  OF  USEFUL  JOINT  EXPECTATIONS 


EU.jXi^PO+B-eOM2- 
E(X2Xi  +  1)  =  (2+4e-?-B;L-2B3)/D- 

E(X1X^  +  1  >  =  (2+2B-26s‘)/^3  • 

E (X2X2  )=(4+86+862-1463-264  )/x4. 

E(X?X.+1 )= (6+246-1 862 -664)/X4 . 

E(XiX^+1)  =  (6+1232-6^3-6Bt*)/XV 

E(X?X2  +  .()  =  (12+.368  +  6062-4863-3684-1265)/X5. 
E(X2X3_1-|)~(  1  2  +  24  6+24  62  +  1263-486tt-1265)/X5. 

E(x?X3  +  ^)=(36  +  1086  +  18062  +  21663-3246''  -1446S-368G)/X  . 


E  ( X  *i  X  -  i)  =  (24  +  968-2462  -2483-4  861,+2465"24  6g)/X5. 

E(XiXt!  i  )  =  (24  +  246~2463+4884-486s)/Xs  . 

E(XGX^1)  =  (1  20  +  6006-1  2062-1  2063  -1  2064  -1  2065-1  206g)/Xg. 

E(X-jX^  +  i  )  =  (1  20+1  206-1  2066  • 

'E(X2X^  +  1 )  =  (48  +  966  +  9662+4863+4064  -24 06s -4 86 6  )/X6  . 

E ( X 4  X 2  )  =  (48+l  926+4  3262  -24063  -l  9264  -1  446S-486G )/X6 • 

i  i  + 1 

E(X$X*  )  =  (  57 6  +  2 304 6  +  51  846 2 +86406 3  +  1  2 0966 4  -1  67046s -8064 6 6 

1  1  +  1 

-288067 “5X668)/A8 . 
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E ( X  .  X  .  .X.  )=(i+3-33)/x3 . 

'  l  1+1  1+2 

E(x^Xi  +  ixi.h2)  =  (2  +  6B-432-2B3)/X'*  . 

E(XiX^+1Xi+2)=( 2+63-83 3+2B4)/x" . 

E(XiXi+iXi+2)=(2+43~2£2-233)/X3 . 

E(X2X2  ,X.  J  =  (4  +  1  63  +  3682-9633h-9634  -8835+3636  )/x5. 
E(X^xi+1X|+2)=(4+123-432-1463+1284-685)/Xs. 

E ( x  .  X  2  , X?,?)  =  (4  +  48+2032  -203  3+885  -1  236  )/x5 • 
E(x-x-H.1Xi+2)=(8+323+4832-5683r4034+865+83&)/A6. 

E(xix?+] xi+2)=(6+63+4232-5433+1035-103e)/As . 
E(xixi+ixi+2)=(1 2+963-3632+6033-15634+20435-1683c)/x6. 

E ( X  .  X ?  ,X?  ,9)  =  (  1  2  +  1  683-276 32 +3483  3 -3 1  23 4  +  7 23 5 ) / X 6 . 

E(xix2  +  1X2  +  2xi.  +  3)  =  (4  +  1  68  +  68  82-1  328  3  +  1  0484  -1  6035  +  1  24  6G  +  487 

-2438)/X6. 

E  ( Xi  Xi  +  1  Xi  +2Xi  +3  )  =  (4+20^-'1  232-283 3  -24  34  -43  5+5636-4437 

+1 23° )/X6  • 

E(X?X.  ,iX.+2X!  )  =  (4  +  243-4432  +  8033-10834  +  6035-203G  +  1237 

1  1  i  +3 

-43° )  A6  • 

E^XiXi+lXi+2Xi+3^=^4+1 6B+4&2"36B 3+52B4"6435+36e6 ’16&? 


E(Xix|  +  1  X.+2Xi  +  3)  =  (2+83-4S2+28  3  -1  434  +  1  0B5-2B6)M5. 

E(X  .  X  .  , ,  X?  ,  0X  .  J  =  (  2+88  +  232  -2633  +  268l,-635  -1  287+888  )/X5 . 
E(X.Xi  +  1X  .+2X^+3  )  =  (  2  +  63-282-483  -28t,-285  )/X5  . 

E ( X  .  X 1  -X.  )  =  (24  +  1  208+4832-9633  -1  688s  +  9686  )/X6  . 

>  l+l  1+2 
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